Electronic apparatus, method for controlling electronic apparatus, and control program

ABSTRACT

To generate multiple types of images of the same subject, an electronic apparatus includes a drive control unit that controls the drive of an image sensor, a division unit that divides an image capture region of the image sensor into at least first and second regions, and an image generation unit that generates a first image by capturing an image of the same subject in the first region and generates a second image by capturing an image of the same subject in the second region.

This application is a Continuation of application Ser. No. 16/177,653,filed Nov. 1, 2018, which is a Continuation of application Ser. No.14/900,802, filed Dec. 22, 2015, which is a national stage applicationof International Application No. PCT/JP2013/068381, filed Jul. 4, 2013.The entire contents of these prior applications are hereby incorporatedby reference.

TECHNICAL FIELD

The present invention relates to an electronic apparatus, a method forcontrolling an electronic apparatus, and a control program.

BACKGROUND ART

Electronic apparatuses each including an image sensor in which aback-illuminated image-capture chip and a signal processing chip arestacked (hereafter referred to as a stacked image sensor) have beenproposed (for example, see Patent Literature 1). In a stacked imagesensor, a back-illuminated image capture chip and a signal processingchip are stacked so as to be connected via micro-bumps corresponding toblocks each including multiple pixels.

CITATION LIST Patent Literature

[Patent Literature 1] Japanese Unexamined Patent Application PublicationNo. 2006-49361

SUMMARY OF INVENTION Technical Problem

However, there have been proposed only a few electronic apparatusesincluding a stacked image sensor that captures images on amultiple-block basis. Accordingly, the usability of electronicapparatuses including a stacked image sensor has not been sufficientlyimproved.

An object of an aspect of the present invention is to generate multipletypes of images of the same subject.

Solution to Problem

A first aspect of the present invention provides an electronic apparatusincluding a drive control unit configured to control drive of an imagesensor, a division unit configured to divide an image capture region ofthe image sensor into at least first and second regions, and an imagegeneration unit configured to generate a first image by capturing animage of an identical subject in the first region and to generate asecond image by capturing an image of the identical subject in thesecond region.

A second aspect of the present invention provides a method forcontrolling an electronic apparatus including an image sensor. Themethod includes dividing an image capture region of the image sensorinto at least first and second regions and generating a first image bycapturing an image of an identical subject in the first region andgenerating a second image by capturing an image of the identical subjectin the second region.

A third aspect of the present invention provides a control program forcausing a control unit of an electronic apparatus including an imagesensor to perform a division process of dividing an image capture regionof an image sensor of the image capture unit into at least first andsecond regions and an image generation process of generating a firstimage by capturing an image of an identical subject in the first regionand generating a second image by capturing an image of the identicalsubject in the second region.

Advantageous Effects of the Invention

According to the aspects of the present invention, multiple types ofimages of the same subject can be generated.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a sectional view of a stacked image sensor.

FIG. 2 is a diagram showing the pixel array of an image capture chip anda unit group.

FIG. 3 is a circuit diagram of a unit group of the image capture chip.

FIG. 4 is a block diagram showing the functional configuration of animage sensor.

FIG. 5 is a block diagram showing the configuration of an electronicapparatus according to a first embodiment.

FIG. 6 is a drawing showing an appearance of a digital camera which isan example of an electronic apparatus.

FIG. 7 is a function block diagram of an image processing unit and asystem control unit.

FIG. 8 includes diagrams showing block arrangement patterns.

FIG. 9 is a flowchart showing an image capture operation performed bythe system control unit.

FIG. 10 is a flowchart showing a block arrangement pattern settingprocess.

FIG. 11 is a diagram showing an example of a second block arrangementpattern set in a second still image mode.

FIG. 12 includes timing charts showing charge accumulation timings in afirst still image mode or second still image mode.

FIG. 13 is a drawing showing an example display in which still imagesare displayed on first and second display units.

FIG. 14 is a diagram showing an example of the second block arrangementpattern set in a second moving image mode.

FIG. 15 is a timing chart showing charge accumulation timings in thesecond moving image mode.

FIG. 16 is a drawing showing an example display in which moving imagesare displayed on the first display unit and a still image is displayedon the second display unit.

FIG. 17 is a diagram showing a fifth block arrangement pattern.

FIG. 18 is a diagram showing a sixth block arrangement pattern.

FIG. 19 is a timing chart showing charge accumulation timings in asecond embodiment.

FIG. 20 is a drawing showing an example display in which still imagesare displayed on a first display unit and a second display unitaccording to the second embodiment.

FIG. 21 is a block diagram showing the configuration of an image capturedevice and an electronic apparatus according to a third embodiment.

EMBODIMENTS OF THE INVENTION

Hereafter, embodiments of the present invention will be described withreference to the drawings. However, the present invention is not limitedthereto. To clarify the embodiments, the drawings are scaled asappropriate, for example, partially enlarged or highlighted.

First Embodiment

FIG. 1 is a sectional view of a stacked image sensor. A stacked imagesensor 100 is disclosed in Japanese Patent Application No. 2012-139026previously filed by the present applicant. The image sensor 100 includesan image-capture chip 113 configured to output a pixel signalcorresponding to incident light, a signal processing chip 111 configuredto process the pixel signal, and a memory chip 112 configured to storethe pixel signal. The image-capture chip 113, signal processing chip111, and memory chip 112 are stacked and electrically connected to oneanother via conductive bumps 109 such as Cu.

As shown in FIG. 1, incident light enters the image sensor 100 in apositive z-axis direction mainly shown by an outline arrow. In thepresent embodiment, the incident light entry surface of theimage-capture chip 113 is referred to as a back surface. Further, asshown by coordinate axes, the direction which is perpendicular to thez-axis and oriented to the left side of the drawing is referred to as apositive x-axis direction, and the direction which is perpendicular tothe z- and x-axes and oriented to the viewer is referred to as apositive y-axis direction. In the following some drawings, coordinateaxes are shown using the coordinate axes of FIG. 1 as a reference sothat the orientations of such drawings are understood.

One example of the image-capture chip 113 is a back-illuminated MOSimage sensor. A PD layer 106 is disposed on the back surface of a wiringlayer 108. The PD layer 106 includes multiple photodiodes (PDs) 104disposed two-dimensionally and configured to accumulate chargecorresponding to incident light and transistors 105 disposed in a mannercorresponding to the PDs 104.

Color filters 102 are disposed over the incident light entry surface ofthe PD layer 106 with a passivation film 103 therebetween. The colorfilters 102 are each a filter which transmits a particular wavelengthrange of visible light. That is, the color filters 102 include multiplecolor filters which transmit different wavelength ranges and arearranged in a particular manner so as to correspond to the PDs 104. Thearrangement of the color filters 102 will be described later. A set of acolor filter 102, a PD 104, and a transistor 105 forms one pixel.

Microlenses 101 are disposed on the incident light entry sides of thecolor filters 102 in a manner corresponding to the pixels. Themicrolenses 101 condense incident light toward the corresponding PDs104.

The wiring layer 108 includes lines 107 configured to transmit pixelsignals from the PD layer 106 to the signal processing chip 111. Thelines 107 may be multilayered and may include passive and activeelements. Multiple bumps 109 are disposed on the front surface of thewiring layer 108 and aligned with multiple bumps 109 disposed on theopposite surface of the signal processing chip 111. The aligned bumps109 are bonded together and electrically connected together, forexample, by pressurizing the image-capture chip 113 and signalprocessing chip 111.

Similarly, multiple bumps 109 are disposed on the opposite surfaces ofthe signal processing chip 111 and memory chip 112 and aligned with eachother. The aligned bumps 109 are bonded together and electricallyconnected together, for example, by pressurizing the signal processingchip 111 and memory chip 112.

The methods for bonding the bumps 109 together include Cu bump bondingusing solid phase diffusion, as well as micro-bump bonding using soldermelting. For the bumps 109, it is only necessary to provide, forexample, one bump or so with respect to one unit group (to be discussedlater). Accordingly, the size of the bumps 109 may be larger than thepitch between the PDs 104. Further, bumps which are larger than thebumps 109 corresponding to a pixel region having the pixels arrangedtherein (a pixel region 113A shown in FIG. 2) may be additionallyprovided in peripheral regions other than the pixel region.

The signal processing chip 111 includes a through-silicon via (TSV) 110configured to connect together circuits disposed on the front and backsurfaces thereof. The TSV 110 is disposed in a peripheral region.Alternatively, the TSV 110 may be disposed in a peripheral region of theimage-capture chip 113 or in the memory chip 112.

FIG. 2 is a diagram showing the pixel array of the image-capture chipand a unit group. In FIG. 2, the image-capture chip 113 is observed fromthe back side. The pixel region 113A is the pixel-arranged region of theimage-capture chip 113. In the pixel region 113A, 20 million or morepixels are arranged in a matrix. In an example shown in FIG. 2, fouradjacent pixels×four adjacent pixels, that is, 16 pixels form one unitgroup 131. Grid lines in FIG. 2 show a concept that adjacent pixels aregrouped into unit groups 131. The number of pixels forming the unitgroups 131 is not limited to that described above and may be on theorder of 1000, for example, 32 pixels×64 pixels, or may be 1000 or moreor less than 1000.

As shown in a partial enlarged view of the pixel region 113A, one unitgroup 131 includes four so-called Bayer arrays which each includes fourpixels, that is, green pixels Gb, Gr, a blue pixel B, and a red pixel Rand which are arranged vertically and horizontally. The green pixels areeach a pixel having a green filter as a color filter 102 and receivelight in the green wavelength band of incident light. Similarly, theblue pixel is a pixel having a blue filter as a color filter 102 andreceives light in the blue wavelength band. The red pixel is a pixelhaving a red filter as a color filter 102 and receives light in the redwavelength band.

FIG. 3 is a circuit diagram of a unit group of the image-capture chip.In FIG. 3, a rectangle surrounded by a dotted line as a representativeshows the circuit of one pixel. At least part of each transistordescribed below corresponds to one transistor 105 in FIG. 1.

As described above, one unit group 131 includes 16 pixels. Sixteen PDs104 included in these pixels are connected to corresponding transfertransistors 302. The gates of the transfer transistors 302 are connectedto a TX line 307 through which a transfer pulse is supplied. In thepresent embodiment, the TX line 307 is shared by the 16 transfertransistors 302.

The drain of each transfer transistor 302 is connected to the source ofa corresponding reset transistor 303, and so-called floating diffusionFD (charge detection unit) therebetween is connected to the gate of acorresponding amplifier transistor 304. The drains of the resettransistors 303 are connected to a Vdd line 310 through which apower-supply voltage is supplied. The gates of the reset transistors 303are connected to a reset line 306 through which a reset pulse issupplied. In the present embodiment, the reset line 306 is shared by the16 reset transistors 303.

The drains of the amplifier transistors 304 are connected to the Vddline 310, through which a power-supply voltage is supplied. The sourcesof the amplifier transistors 304 are connected to the drains ofcorresponding select transistors 305. The gates of the selecttransistors 305 are connected to corresponding decoder lines 308 throughwhich a selection pulse is supplied. In the present embodiment, thedifferent decoder lines 308 are disposed with respect to the 16 selecttransistors 305. The sources of the select transistors 305 are connectedto a shared output line 309. A load current source 311 supplies acurrent to the output line 309. That is, the output line 309 withrespect to the select transistors 305 is formed by a source follower.The load current source 311 may be disposed in any of the image-capturechip 113 and signal processing chip 111.

Described below is the flow from when the accumulation of charge startsto when pixel signals are outputted after the accumulation ends. Resetpulses are applied to the reset transistors 303 through the reset line306. Simultaneously, transfer pulses are applied to the transfertransistors 302 through the TX line 307. Thus, the potentials of the PDs104 and floating diffusion FD are reset.

When the application of the transfer pulses is released, the PDs 104convert received incident light into charge and accumulate it.Subsequently, when transfer pulses are applied again with reset pulsesnot being applied, the charge accumulated in each PD 104 is transferredto the corresponding floating diffusion FD. Thus, the potential of thefloating diffusion FD is changed from the reset potential to the signalpotential after the charge accumulation. When selection pulses areapplied to the select transistors 305 through the decoder lines 308, thevariation in the signal potential of each floating diffusion FD istransmitted to the output line 309 through the corresponding amplifiertransistor 304 and select transistor 305. Based on such a circuitoperation, the unit pixels output, to the output line 309, pixel signalscorresponding to the reset potentials and pixel signals corresponding tothe signal potentials.

As shown in FIG. 3, in the present embodiment, the reset line 306 and TXline 307 are shared by the 16 pixels forming the unit group 131. Thatis, reset pulses and transfer pulses are simultaneously applied to allthe 16 pixels. Accordingly, all the pixels forming the unit group 131start to accumulate charge at the same timing and end the chargeaccumulation at the same timing. Note that selection pulses aresequentially applied to the select transistors 305 and therefore pixelsignals corresponding to the accumulated charge are selectivelyoutputted to the output line 309. Different reset lines 306, TX lines307, and output lines 309 are disposed for the respective unit groups131.

By constructing the circuit on the basis of unit groups 131 as describedabove, the charge accumulation time can be controlled for each unitgroup 131. In other words, it is possible to cause the unit groups 131to output pixel signals based on different charge accumulation times.More specifically, by causing another unit group 131 to accumulatecharge several times and to output pixel signals each time while oneunit group 131 is caused to accumulate charge once, it is possible tocause the unit groups 131 to output moving image frames at differentframe rates.

FIG. 4 is a block diagram showing the functional configuration of theimage sensor. An analog multiplexer 411 sequentially selects 16 PDs 104forming one unit group 131 and causes each selected PD 104 to output apixel signal to an output line 309 disposed in a manner corresponding tothe unit group 131. The multiplexer 411 is formed along with the PDs 104in the image-capture chip 113.

The analog pixel signals outputted through the multiplexer 411 areamplified by an amplifier 412 which is formed in the signal processingchip 111. The pixel signals amplified by the amplifier 412 are subjectedto correlated double sampling (CDS) and analog-to-digital (A/D)conversion by a signal processing circuit 413 formed in the signalprocessing chip 111 and configured to perform CDS and A/D conversion.Since the pixel signals are subjected to CDS by the signal processingcircuit 413, the noise in the pixel signals is reduced. TheA/D-converted pixel signals are passed to a demultiplexer 414 and thenstored in corresponding pixel memories 415. The demultiplexer 414 andpixel memories 415 are formed in the memory chip 112.

An arithmetic circuit 416 processes the pixel signals stored in thepixel memories 415 and passes the resulting signals to a subsequentimage processing unit. The arithmetic circuit 416 may be disposed in anyof the signal processing chip 111 and memory chip 112. While theelements connected to the single unit group 131 are shown in FIG. 4,these elements are disposed for each unit group 131 in practice andoperate in parallel. Note that the arithmetic circuit 416 need notnecessarily be disposed for each unit group 131. For example, a singlearithmetic circuit 416 may sequentially refer to and process the valuesin the pixel memories 415 corresponding to the respective unit groups131.

As described above, the output lines 309 are disposed in a mannercorresponding to the respective unit groups 131. In the image sensor100, the image-capture chip 113, signal processing chip 111, and memorychip 112 are stacked. Accordingly, by using, as the output lines 309,the bumps 109 electrically connecting between the chips, the lines canbe routed without enlarging the chips in the surface direction.

Next, blocks set in the pixel region 113A (see FIG. 2) of the imagesensor 100 will be described. In the present embodiment, the pixelregion 113A of the image sensor 100 is divided into multiple blocks.Each block includes at least one unit group 131. Pixels included in therespective blocks are controlled by different control parameters. Thatis, the control parameter varies between pixel signals acquired frompixels included in one block and pixel signals acquired from pixelsincluded in another block. Examples of a control parameter include thecharge accumulation time or frequency, the frame rate, the gain, thethinning-out rate, the number of rows or columns whose pixel signals aresummed up, and the digitized bit number. The control parameters may beparameters used in image processing following the acquisition of imagesignals from the pixels.

As used herein, the charge accumulation time refers to the time fromwhen the PDs 104 start to accumulate charge to when they end theaccumulation. The charge accumulation frequency refers to the frequencywith which the PDs 104 accumulate charge per unit time. The frame raterefers to the number of frames processed (displayed or recorded) perunit time in a moving image. The frame rate is expressed in frames persecond (fps). As the frame rate is increased, a subject (i.e., subjectswhose images are to be captured) moves more smoothly in a moving image.

The gain refers to the gain factor (amplification factor) of theamplifier 412. By changing the gain, the ISO sensitivity can be changed.The ISO sensitivity is a standard for photographic films developed bythe ISO and represents the level of the weakest light which aphotographic film can record. Typically, the sensitivity of imagesensors is represented by the ISO sensitivity. In this case, the abilityof the image sensor 100 to capture light is represented by the value ofthe ISO sensitivity. When the gain is increased, the ISO sensitivity isincreased as well. For example, when the gain is doubled, the electricalsignal (pixel signal) is doubled as well. Thus, appropriate brightnessis obtained even when the amount of incident light is halved. However,the increase in gain amplifies noise included in the electric signal,thereby increasing noise.

The thinning-out rate refers to the ratio of the number of pixels fromwhich pixel signals are not read to the total number of pixels in apredetermined region. For example, a thinning-out rate of apredetermined region of 0 means that pixel signals are read from allpixels in the predetermined region. A thinning-out rate of apredetermined region of 0.5 means that pixel signals are read from halfthe pixels in the predetermined region. Specifically, where a unit group131 is a Bayer array, one Bayer array unit from which pixel signals areread and one Bayer array unit from which pixel signals are not read arealternately set in the vertical direction, that is, two pixels (tworows) from which pixel signals are read and two pixels (two rows) fromwhich pixel signals are not read are alternately set in the verticaldirection. On the other hand, when the pixels from which pixel signalsare read are thinned out, the resolution of images is reduced. However,20 million or more pixels are arranged in the image sensor 100 andtherefore, even when the pixels are thinned out, for example, at athinning-out rate of 0.5, images can be displayed with 10 million ormore pixels. For this reason, the user (operator) seems not to worryabout such a resolution reduction.

The number of rows whose pixel signals are summed up refers to thenumber of vertically adjacent pixels whose pixel signals are summed up.The number of columns whose pixel signals are summed up refers to thenumber of horizontally adjacent pixels whose pixel signals are summedup. Such a summation process is performed, for example, in thearithmetic circuit 416. When the arithmetic circuit 416 sums up pixelsignals of a predetermined number of vertically or horizontally adjacentpixels, there is obtained an effect similar to that obtained by thinningout the pixels at a predetermined thinning-out rate and reading pixelsignals from the resulting pixels. In the summation process, an averagevalue may be calculated by dividing the sum of the pixel signals by therow number or column number obtained by the arithmetic circuit 416.

The digitized bit number refers to the number of bits of a digitalsignal converted from an analog signal by the signal processing circuit413. As the number of bits of a digital signal is increased, luminance,color change, or the like is represented in more detail.

In the present embodiment, the accumulation conditions refer to theconditions on the accumulation of charge in the image sensor 100.Specifically, the accumulation conditions refer to the chargeaccumulation time or frequency, frame rate, and gain of the controlparameters. Since the frame rate can change according to the chargeaccumulation time or frequency, it is included in the accumulationconditions. Similarly, the correct amount of exposure can changeaccording to the gain, and the charge accumulation time or frequency canchange according to the correct amount of exposure. Accordingly, thegain is included in the accumulation conditions.

The image-capture conditions refer to conditions on image-capture of asubject. Specifically, the image-capture conditions refer to controlparameters including the accumulation conditions. The image-captureconditions includes control parameters for controlling the image sensor100 (e.g., the charge accumulation time or frequency, frame rate, gain),as well as control parameters for controlling reading of signals fromthe image sensor 100 (e.g., thinning-out rate), and control parametersfor processing signals from the image sensor 100 (e.g., the number ofrows or columns whose pixel signals are summed up, digitized bit number,and control parameters used when an image processing unit 30 (to bediscussed later) processes images).

FIG. 5 is a block diagram showing the configuration of an electronicapparatus according to the first embodiment. The electronic apparatus 1shown in FIG. 5 includes digital cameras, smartphones, mobile phones,and personal computers which each have an image capture function. Asshown in FIG. 5, an electronic apparatus 1 includes a lens unit 10, animage-capture unit 20, the image processing unit 30, a work memory 40, adisplay unit 50, an operation unit 55, a recording unit 60, and a systemcontrol unit 70. The lens unit 10 is an image-capture optical systemincluding multiple lenses. The lens unit 10 guides a pencil of rays froma subject to the image-capture unit 20. The lens unit 10 may be integralwith the electronic apparatus 1 or may be an interchangeable lens whichis detachable from the electronic apparatus 1. The lens unit 10 may alsoinclude a focus lens or zoom lens.

The image-capture unit 20 includes the image sensor 100 and a drive unit21. The drive unit 21 is a control circuit configured to control thedrive of the image sensor 100 in accordance with an instruction from thesystem control unit 70. Specifically, the drive unit 21 controls thecharge accumulation time or frequency, which is a control parameter, bycontrolling the timing (or the cycle of the timing) when reset pulses ortransfer pulses are applied to the reset transistors 303 or transfertransistors 302, respectively. The drive unit 21 also controls the framerate by controlling the timing (or the cycle of timing) when resetpulses, transfer pulses, or selection pulses are applied to the resettransistors 303, transfer transistor 302, or select transistors 305,respectively. The drive unit 21 also controls the thinning-out rate bysetting pixels to which reset pulses, transfer pulses, and selectionpulses are applied.

The drive unit 21 also controls the ISO sensitivity of the image sensor100 by controlling the gain (also called the gain factor oramplification factor) of the amplifier 412. The drive unit 21 also setsthe number of rows or columns whose pixel signals are summed up bytransmitting an instruction to the arithmetic circuit 416. The driveunit 21 also sets the digitized bit number by transmitting aninstruction to the signal processing circuit 413. The drive unit 21 alsosets blocks in the pixel region (image-capture region) 113A of the imagesensor 100. As seen above, the drive unit 21 serves as an image sensorcontrol unit that causes the image sensor 100 to capture an image underimage-capture conditions which vary among the blocks and then to outputpixel signals. The system control unit 70 transmits an instruction aboutthe position, shape, range, or the like of blocks to the drive unit 21.

The image sensor 100 passes the pixel signals from the image sensor 100to the image processing unit 30. The image processing unit 30 generatesimage data by performing various types of image processing on raw datacomposed of the pixel signals of the pixels using the work memory 40 aswork space. The image processing unit 30 includes a first imageprocessing unit 30A and a second image processing unit 30B. When theload of image processing is high, the processing is distributed to thefirst image processing unit 30A and second image processing unit 30B.The first image processing unit 30A and second image processing unit 30Bthen perform the distributed processing in parallel.

In the present embodiment, as will be described later, the systemcontrol unit 70 (specifically, a division unit 71 shown in FIG. 7)divides the pixel region (image capture region) 113A of the image sensor100 into at least first and second regions. The system control unit 70(specifically, a drive control unit 72 shown in FIG. 7) also controlsthe drive of the image sensor 100 so that the image sensor 100 capturesimages in the first and second regions on different image captureconditions. In this case, for example, the first image processing unit30A performs image processing on signals from the first region, and thesecond image processing unit 30B performs image processing on signalsfrom the second region. Note that the pixel region (image captureregion) 113A of the image sensor 100 need not be divided into the tworegions composed of the first and second regions and may be divided intomultiple regions composed of a first region, a second region, a thirdregion, and the like. In this case, image processing with respect to themultiple regions is distributed to the first image processing unit 30Aand second image processing unit 30B as appropriate. The distribution ofimage processing may be previously determined on the basis of the numberof regions obtained by division, the ranges of the regions, or the like.The system control unit 70 may determine the distribution on the basisof the number of regions obtained by division, the ranges of theregions, or the like.

The image processing unit 30 performs various types of image processing.For example, the image processing unit 30 performs color signalprocessing (tone correction) on signals obtained from a Bayer array soas to generate RGB image signals. The image processing unit 30 thenperforms image processing such as white balance adjustment, sharpnessadjustment, gamma correction, gradation adjustment, or the like on theRGB image signals. The image processing unit 30 compresses the resultingsignals in a predetermined compression format (JPEG format, MPEG format,or the like), if necessary. The image processing unit 30 then outputsthe resulting image data to the recording unit 60. The image processingunit 30 also outputs the image data to the display unit 50.

In the present embodiment, the image processing unit 30 performs theabove processes, as well as detects a main subject from the image data.As used herein, the term “main subject” refers to a subject which isnoted or assumed to be noted by the user (operator), of subjects whoseimages are to be captured. The number of main subjects in the image datais not limited to one, and multiple main subjects may be present (forexample, see FIG. 14).

Parameters referred to when the image processing unit 30 performs imageprocessing are also included in the control parameters (image captureconditions). For example, parameters such as color signal processing(tone correction), white balance adjustment, gradation adjustment, andcompressibility are included in the control parameters. The signals readfrom the image sensor 100 vary with the charge accumulation time or thelike, and the parameters referred to when image processing is performedalso vary with the variations in the signals. The image processing unit30 sets different control parameters for the respective blocks andperforms image processing such as color signal processing on the basisof the control parameters.

The image processing unit 30 extracts or discards frames correspondingto predetermined timings from multiple frames chronologically obtainedfrom the image capture unit 20. Thus, it is possible to reduce theamount of data to reduce the load on subsequent processes. The imageprocessing unit 30 also calculates one or more frames to be interpolatedbetween multiple frames chronologically obtained from the image captureunit 20 and then interpolates the calculated one or more frames betweenthe multiple frames. Thus, it is possible to play back moving images insuch a manner that the images move more smoothly. While the drive unit21 is configured to control the thinning-out rate, other configurationsmay be employed. For example, the image processing unit 30 or arithmeticcircuit 416 may control the thinning-out rate by discardingpredetermined pixel signals of pixel signals read from all the pixels bythe drive unit 21.

The work memory 40 temporarily stores image data or the like when theimage processing unit 30 performs image processing. The display unit 50is, for example, a liquid crystal display panel. As shown in FIG. 5, thedisplay unit 50 includes a first display unit 51, a first touchscreen52, a second display unit 53, and a second touchscreen 54.

The first display unit 51 displays images (still images, moving images,live view images) captured by the image capture unit 20, or varioustypes of information. The first touchscreen 52 is formed on the displayscreen of the first display unit 51. When the user touches the firsttouchscreen 52, for example, to select an image [a thumbnail image (tobe discussed later); see FIG. 13], the first touchscreen 52 outputs asignal indicating the touched position to the system control unit 70.The second display unit 53 displays images (still images, moving images,live view images) captured by the image capture unit 20, or varioustypes of information. The second touchscreen 54 is formed on the displayscreen of the second display unit 53. When the user touches the secondtouchscreen 54, for example, to select an image, the second touchscreen54 outputs a signal indicating the touched position to the systemcontrol unit 70.

The operation unit 55 includes a release switch, a moving image switch,and other types of operation switches operated by the user. Theoperation unit 55 outputs a signal corresponding to an operationperformed by the user to the system control unit 70. The recording unit60 has two card slots into which two storage media (first storage medium61, second storage medium 62) such as memory cards can be inserted. Therecording unit 60 stores image data generated by the image processingunit 30 or various types of data in the storage media (first storagemedium 61, second storage medium 62) inserted in the card slots. In thepresent embodiment, as described above, the first image processing unit30A and second image processing unit 30B perform image processing onsignals from the first region and signals from the second region,respectively, in parallel. At this time, the first storage medium 61stores image data based on the signals from the first region inaccordance with an operation of the release switch or moving imageswitch. Similarly, the second storage medium 62 stores image data basedon the signals from the second region in accordance with an operation ofthe release switch or moving image switch. The recording unit 60 alsoincludes an internal memory. The recording unit 60 may record the imagedata generated by the image processing unit 30 or various types of datain the internal memory.

The system control unit 70 controls the entire processing and operationof the electronic apparatus 1. The system control unit 70 includes acentral processing unit (CPU) 70A. In the present embodiment, the systemcontrol unit 70 divides the image capture surface (pixel region 113A) ofthe image sensor 100 into multiple blocks and causes the image sensor100 to capture images in the blocks with different charge accumulationtimes (or charge accumulation frequencies), different frame rates,and/or different gains. For this reason, the system control unit 70transmits, to the drive unit 21, the positions, shapes, and ranges ofthe blocks and accumulation conditions for the blocks. The systemcontrol unit 70 also causes the image sensor 100 to capture images inthe blocks with different thinning-out rates, the different numbers ofrows or columns whose pixel signals are summed up, and/or differentdigitized bit numbers. For this reason, the system control unit 70transmits, to the drive unit 21, the image capture conditions(thinning-out rates, the numbers of rows or columns whose pixel signalsare summed up, and digitized bit numbers) for the blocks. The imageprocessing unit 30 performs image processing on image capture conditions(control parameters such as color signal processing, white balanceadjustment, gradation adjustment, and compressibility) which vary amongthe blocks. For this reason, the image processing unit 70 transmits, tothe image processing unit 30, the image capture conditions (controlparameters such as color signal processing, white balance adjustment,gradation adjustment, and compressibility) for the blocks.

The system control unit 70 records the image data generated by the imageprocessing unit 30 in the recording unit 60. The system control unit 70also outputs the image data generated by the image processing unit 30 tothe display unit 50 so as to display images on the display unit 50 (oneor both of the first display unit 51 and touchscreen 52). The systemcontrol unit 70 also reads image data recorded in the recording unit 60and outputs it to the display unit 50 so as to display images on thedisplay unit 50 (one or both of the first display unit 51 andtouchscreen 52). The images displayed on the first display unit 51 arestill images, moving images, or live view images. As used herein, theterm “live view images” refer to images displayed on the display unit 50on the basis of image data sequentially generated and outputted by theimage processing unit 30. The user uses live view images to check imagesof the subject being captured by the image capture unit 20. Live viewimages are also called through images or preview images.

FIG. 6 is a drawing showing an appearance of a digital camera which isan example of an electronic apparatus. FIG. 6 shows an appearance of theelectronic apparatus (digital camera) 1 seen from the back. As shown inFIG. 6, the first display unit 51 is a display panel having arectangular display screen. The first display unit 51 is disposed on theback of the electronic apparatus 1. The first touchscreen 52 is formedon the display screen of the first display unit 51.

The second display unit 53 is a display panel having a rectangulardisplay screen. An edge of the second display unit 53 is rotatablycoupled to the first display unit 51 through a hinge (not shown)disposed on the back of the electronic apparatus 1 and under the firstdisplay unit 51. When the second display unit 53 is rotated using thehinge as a pivot, the first display unit 51 is opened or closed by thesecond display unit 53.

The electronic apparatus 1 has a release switch 55 a, a mode dial 55 b,and a moving image switch 55 c on the upper surface thereof. The releaseswitch 55 a is a switch that the user presses to capture a still image.A shooting preparation such as automatic focusing (AF) or automaticexposure (AE) is made by pressing the release switch 55 a halfway. Themode dial 55 b is a dial that the user rotates to set a scene mode suchas portrait, landscape, or nightscape. The moving image switch 55 c is aswitch that the user presses to capture moving images. Further, amulti-selector 55 d is disposed on the back of the electronic apparatus1 and on a side of the first display unit 51. The multi-selector 55 dincludes upper, lower, left, and right arrow keys and OK switch that theuser uses to make a selection in a menu (a menu for setting the imagecapture mode) displayed on the first display unit 51 or second displayunit 53. The operation unit 55 includes the release switch 55 a, modedial 55 b, moving image switch 55 c, and multi-selector 55 d. Theoperation unit 55 may further include other switches or the like.

FIG. 7 is a function block diagram of the image processing unit andsystem control unit shown in FIG. 5. As shown in FIG. 7, the first imageprocessing unit 30A includes an image generation unit 31A and adetection unit 32A. The image generation unit 31A generates image databy performing various types of image processing on RAW data outputtedfrom the image capture unit 20. The RAW data is composed of the pixelsignals from the pixels in the first region. The detection unit 32Adetects a main subject from the image data generated by the imagegeneration unit 31A. In the present embodiment, the detection unit 32Amakes a comparison among multiple pieces of image data chronologicallyobtained from live view images generated by the image generation unit31A and detects a moving subject as a main subject. The detection unit32A also detects a main subject using, for example, a face detectionfunction as described in Japanese Unexamined Patent ApplicationPublication No. 2010-16621 (US 2010/0002940). In addition to facedetection, the detection unit 32A also detects a human body included inimage data as a main subject, as described in Japanese Unexamined PatentApplication Publication No. 2010-16621 (US 2010/0002940).

The second image processing unit 30B includes an image generation unit31B. The image generation unit 31B generates image data by performingvarious types of image processing on RAW data outputted from the imagecapture unit 20. The RAW data is composed of the pixel signals from thepixels in the second region. While the second image processing unit 30Bdoes not include a detection unit, it may include a detection unit.There may be employed a configuration in which the first imageprocessing unit 30A does not include the detection unit 32A and thesecond image processing unit 30B includes a detection unit. In thepresent embodiment, the image generation unit 31A and image generationunit 31B may be collectively referred to as an image generation unit 31.

The system control unit 70 includes a division unit 71, a drive controlunit 72, and a display control unit 73. The division unit 71 divides thepixel region (image capture region) 113A of the image sensor 100 intomultiple regions on a block basis. The division unit 71 divides thepixel region 113A into multiple regions on the basis of a predeterminedblock arrangement pattern of the pixel region 113A [see FIGS. 8(A) to8(D)]. The drive control unit 72 sets image capture conditions for themultiple regions. The drive control unit 72 also controls the drive ofthe image sensor 100 in response to the user operating the releaseswitch 55 a or moving image switch 55 c. Even during capture of liveview images (that is, after starting an image capture operationfollowing power-on), the drive control unit 72 controls the drive of theimage sensor 100. The display control unit 73 outputs the image datagenerated by the image generation unit 31 to the display unit 50 so asto display images (still images, moving images, live view images) on oneor both of the first display unit 51 and second display unit 53.

The division unit 71, drive control unit 72, and display control unit 73of the system control unit 70 are implemented when the CPU 70A performsprocessing on the basis of a control program.

Next, a block arrangement pattern set by the division unit 71 will bedescribed. FIG. 8 includes diagrams showing block arrangement patterns,in which FIG. 8(A) shows a first block arrangement pattern; FIG. 8(B)shows a second block arrangement pattern; FIG. 8(C) shows a third blockarrangement pattern; and FIG. 8(D) shows a fourth block arrangementpattern.

The first block arrangement pattern shown in FIG. 8(A) is a blockarrangement pattern in which the pixel region 113A is divided into tworegions, first and second regions. In the first block arrangementpattern, the first region of the pixel region 113A is composed of blocksin (2m−1)th columns, and the second region thereof is composed of blocksin (2m)th columns. That is, the blocks in the pixel region 113A aregrouped into the odd columns and even columns. As used herein, m is apositive integer (m=1, 2, 3, etc.).

The second block arrangement pattern shown in FIG. 8(B) is also a blockarrangement pattern in which the pixel region 113A is divided into tworegions, first and second regions. In the second block arrangementpattern, the first region of the pixel region 113A is composed of blocksin (2n−1)th rows, and the second region thereof is composed of blocks in(2n)th rows. That is, the blocks in the pixel region 113A are groupedinto the odd rows and even rows. As used herein, n is a positive integer(n=1, 2, 3, etc.).

The third block arrangement pattern shown in FIG. 8(C) is also a blockarrangement pattern in which the pixel region 113A is divided into tworegions, first and second regions. In the third block arrangementpattern, the first region of the pixel region 113A is composed of blocksin (2m−1)th columns and in (2n−1)th rows and blocks in (2m)th columnsand in (2n)th rows. The second region thereof is composed of blocks in(2m)th columns and in (2n−1)th rows and blocks in (2m−1)th columns andin (2n)th rows That is, the pixel region 113A is divided in such amanner that the blocks form a check pattern. As used herein, m and n arepositive integers (m=1, 2, 3, etc.; n=1, 2, 3, etc.). In the presentembodiment, as shown in FIGS. 8(A) to 8(C), the first and second regionsare not necessarily composed of only continuous blocks and may becomposed of discrete blocks.

The fourth block arrangement pattern shown in FIG. 8(D) is a blockarrangement pattern in which the pixel region 113A is divided into threeregions, first to third regions. In the fourth block arrangementpattern, the first region of the pixel region 113A is composed of blocksin (3m−2)th columns; the second region thereof is composed of blocks in(3m−1)th columns; and the third region thereof is composed of blocks in(3m)th columns. As used herein, m is a positive integer (m=1, 2, 3,etc.).

While, in FIG. 8, a small number of blocks are set in the pixel region113A to make it easy to see the block arrangement in each region, alarger number of blocks than the number of blocks shown in FIG. 8 may beset.

Next, an image capture operation according to the first embodiment willbe described. FIG. 9 is a flowchart showing an image capture operationperformed by the system control unit. FIG. 10 is a flowchart showing ablock arrangement pattern setting process. In the process shown in FIG.9, the system control unit 70 starts to capture images when theelectronic apparatus 1 is powered on. Although not shown in FIG. 9, whenthe system control unit 70 starts to capture images, the display controlunit 73 displays live view images captured by the image capture unit 20on the first display unit 51, as well as displays the menu for settingthe image capture mode on the second display unit 53. Since live viewimages need not be images in which the subject moves smoothly, the drivecontrol unit 72 controls the drive of the image sensor 100 so that theimage sensor 100 captures images at a low frame rate. The displaycontrol unit 73 may display live view images on the second display unit53 and may display the menu on the first display unit 51. The displaycontrol unit 73 may also display live view images and the menu on thesame display unit (first display unit 51 or second display unit 53).

The user operates the multi-selector 55 d to select between imagecapture modes on the menu displayed on the second display unit 53. Thedivision unit 71 identifies the image capture mode that the user hasselected by operating the multi-selector 55 d (step S1).

The image capture modes include a still image mode in which still imagesare captured and a moving image mode in which moving images arecaptured. The still image mode includes a first still image mode and asecond still image mode. The moving image mode includes a first movingimage mode and a second moving image mode.

The first still image mode refers to an image capture mode in which theimage sensor 100 captures still images of the subject using the pixelregion (image capture region) 113A thereof as a single region withoutthe division unit 71 dividing the pixel region 113A. The first stillimage mode is a typical still image mode. The second still image mode isan image capture mode in which the division unit 71 divides the pixelregion 113A into multiple regions and the image sensor 100 capturesstill images of the same subject in the multiple regions. In the secondstill image mode, the image sensor 100 can continuously capture stillimages of the same subject in the multiple regions in parallel.Accordingly, a larger number of still images can be captured per unittime by continuously capturing still images in the second still imagemode than by continuously capturing still images in the first stillimage mode. That is, continuous image capture can be performed at higherspeed in the second still image mode than in the first still image mode.The second still image mode is also called high-speed continuousshooting mode or still image-still image mixed mode.

The first moving image mode refers to an image capture mode in which theimage sensor 100 captures moving images of the subject using the pixelregion (image capture region) 113A thereof as a single region withoutthe division unit 71 dividing the pixel region 113A. The first movingimage mode is a typical moving image capture mode. The second movingimage mode refers to an image capture mode in which the division unit 71divides the pixel region 113A into multiple regions and the image sensor100 captures still images of the subject in one of the multiple regionsand captures moving images of the same subject in the others of themultiple regions. The second moving image mode is also called stillimage-moving image simultaneous capture mode or still image-moving imagemixed mode.

There may be employed a configuration in which the user selects theimage capture mode by touching a corresponding position in the menu onthe second touchscreen 54 rather than operating the multi-selector 55 d.

The division unit 71 determines whether the image capture mode selectedby the user is the still image mode (step S2). If the division unit 71determines that the image capture mode is the still image mode, itdetermines whether the still image mode is the first still image mode(step S3). If the division unit 71 determines that the still image modeis the first still image mode, it sets the image capture mode to thefirst still image mode (step S4). In contrast, if the division unit 71determines that the still image mode is not the first still image mode,that is, the still image mode is the second still image mode, it setsthe image capture mode to the second still image mode (step S5).

In step S4 or step S5, the division unit 71 performs the blockarrangement pattern setting process shown in FIG. 10. In the processshown in FIG. 10, the division unit 71 instructs the image processingunit 30 (first image processing unit 30A) to detect main subjects (stepS21). The detection unit 32A then detects moving subject and non-movingsubjects by making a comparison among multiple pieces of image datachronologically obtained from live view images. The detection unit 32Athen outputs the detection result along with the image data to thesystem control unit 70. The division unit 71 checks whether there aremain subjects, on the basis of the detection result from the detectionunit 32A. The division unit 71 then sets a region (s) corresponding tothe main subject and the image capture mode in the pixel region 113A(step S22).

Specifically, if the image capture mode is the first still image mode,the division unit 71 does not divide the pixel region 113A into multipleregions. That is, the division unit 71 sets the entire pixel region 113Aas a single region. At this time, the division unit 71 outputs, to thedrive unit 21, an instruction signal instructing the drive unit 21 toset the entire pixel region 113A as a single region.

In contrast, if the image capture mode is the second still image mode,the division unit 71 selects one of the block arrangement patterns shownin FIGS. 8(A) to 8(D). The division unit 71 then checks whether the mainsubject is a moving subject, on the basis of the detection result fromthe detection unit 32A. If the main subject is not a moving subject buta non-moving subject, the division unit 71 sets first and second regionsin accordance with the third block arrangement pattern shown in FIG.8(C). If the main subject is a moving subject, the division unit 71identifies the moving direction of the moving subject. If the movingdirection of the moving subject is mostly vertical, for example, if themain subject is a child who is sliding down a slide, a waterfall, or thelike, the division unit 71 sets first and second regions in accordancewith the first block arrangement pattern shown in FIG. 8(A). If themoving direction of the moving subject is mostly horizontal, forexample, if the main subject is a running person or the like or if theuser is panning, the division unit 71 sets first and second regions inaccordance with the second block arrangement pattern shown in FIG. 8(B).If the vertical moving speed of the moving subject is high, the divisionunit 71 sets first to third regions in accordance with the fourth blockarrangement pattern shown in FIG. 8(D). In step S22, the division unit71 outputs, to the drive unit 21, an instruction signal indicating theblock positions or the like in the respective regions (first and secondregions, first to third regions).

FIG. 11 is a diagram showing an example of the second block arrangementpattern set in the second still image mode. Note that in FIG. 11, theblocks are scaled up in order to make it easy to see the blockarrangement. In practice, smaller blocks than the blocks shown in FIG.11 are set in the pixel region 113A. In the example shown in FIG. 11,the detection unit 32A detects persons O1, O2 who are playing soccer anda soccer ball O3 as main subjects (moving subjects). The division unit71 determines that the main subjects O1 to O3 are moving subjects andthe moving directions of the moving subjects are mostly horizontal, onthe basis of the detection result from the detection unit 32A. As aresult, the division unit 71 sets first and second regions in accordancewith the second block arrangement pattern shown in FIG. 8(B). At thistime, the division unit divides the pixel region 113A in such a mannerthat the main subjects O1 to O3 are contained in both the first andsecond regions.

Referring back to FIG. 10, the drive control unit 72 sets image captureconditions for the regions set in step S22 (the first and second regionsin the example shown in FIG. 11) on the basis of the detection resultfrom the detection unit 32A (step S23). Specifically, the drive controlunit 72 outputs, to the drive unit 21, an instruction signal indicatingimage capture conditions (charge accumulation times, gains, etc.)corresponding to the main subjects. The drive control unit 72 alsooutputs, to the image processing unit 30, an instruction signalindicating image capture conditions (parameters such as color signalprocessing, white balance adjustment, gradation adjustment, andcompressibility) corresponding to the main subjects. For example, if thedetection unit 32A detects a moving subject, the drive control unit 72increases the gain (ISO sensitivity), as well as reduces the chargeaccumulation time (that is, exposition time, shutter speed). If thedetection unit 32A does not detect any moving subject, the drive controlunit 72 reduces the gain, as well as increases the charge accumulationtime.

Referring back to FIG. 9, the drive control unit 72 determines whetherthe user has operated the release switch 55 a (pressed it all the wayfollowing halfway) (step S6). If the drive control unit 72 determinesthat the user has operated the release switch 55 a, it causes the imagecapture unit 20 to capture images in the still image mode (first stillimage mode or second still image mode) (step S7).

FIG. 12 is a timing chart showing charge accumulation timings in thefirst still image mode and second still image mode. In the first stillimage mode (typical continuous shooting mode) shown in FIG. 12(A), asdescribed above, the entire pixel region 113A is set as a single region.While the user operates the release switch 55 a (presses it all the way)in the first still image mode, the drive control unit 72 outputs, to thedrive unit 21, an instruction signal instructing the drive unit 21 torepeatedly capture a still image in the entire pixel region 113A. InFIG. 12(A), the drive unit 21 causes the image sensor 100 to startcharge accumulation in the pixel region 113A at time t1 and to end thecharge accumulation in the pixel region 113A at time t3. The drive unit21 then reads pixel signals from the pixels in the pixel region 113A andresets the charge accumulated in each pixel. Subsequently, the driveunit 21 causes the image sensor 100 to starts charge accumulation in thepixel region 113A at time t4 and to end the charge accumulation in thepixel region 113A at time t7. While the user operates the release switch55 a, the drive unit 21 repeatedly performs the drive control of theimage sensor 100 as described above.

In the example shown in FIG. 12(A), the drive unit 21 has captured animage four times continuously in the period from time t1 to time t15.The period from time t1 to time t3, the period from time t4 to time t7,the period from time t8 to time t11, and the period from time t12 totime t15 are charge accumulation times (exposure times). These chargeaccumulation times (exposure times) are set in the image capturecondition setting process in step S23. The pixel signals read from thepixels in the image sensor 100 are amplified by the amplifier 412 usingthe gain indicated by the division unit 71 and then outputted to theimage processing unit 30. The image generation unit 31 (e.g., the imagegeneration unit 31A) identifies the parameters used in image processing,such as color signal processing, on the basis of the instruction signaloutputted from the division unit 71 and indicating the image captureconditions. The image generation unit 31 then generates image data byperforming various types of image processing on RAW data composed of thepixel signals on the basis of the parameters.

In the second still image mode (high-speed continuous shooting mode)shown in FIG. 12(B), the drive unit 21 sets, for example, first andsecond regions. While the user operates the release switch 55 a (pressesit all the way) in the second still image mode, the drive control unit72 outputs, to the drive unit 21, an instruction signal instructing thedrive unit 21 to repeatedly capture a still image in both the first andsecond regions. In FIG. 12(B), the drive unit 21 causes the image sensor100 to start charge accumulation in the first region at time t1 and toend the charge accumulation in the first region at time t3. The driveunit 21 reads pixel signals from the pixels in the first region andresets the charge accumulated in each pixel. Subsequently, the driveunit 21 causes the image sensor 100 to start charge accumulation in thefirst region at time t4 and to end the charge accumulation in the firstregion at time t7. While the user operates the release switch 55 a, thedrive unit 21 repeatedly performs the drive control of the image sensor100 as described above.

In FIG. 12(B), the drive unit 21 causes the image sensor 100 to startcharge accumulation in the second region at time t2 and to end thecharge accumulation in the second region at time t5. The drive unit 21then reads pixel signals from the pixels in the second region and resetsthe charge accumulated in each pixel. Subsequently, the drive unit 21causes the image sensor 100 to start charge accumulation in the secondregion at time t6 and to end the charge accumulation in the secondregion at time t9. While the user operates the release switch 55 a, thedrive unit 21 repeatedly performs the drive control of the image sensor100 as described above.

In the example shown in FIG. 12(B), the drive unit 21 has captured animage in the first region four times continuously in the period fromtime t1 to time t15. Further, in parallel with the four-time imagecapture in the first region, the drive unit has captured an image in thesecond region four times continuously in the period from time t2 to timet16. This means that the drive unit 21 has captured an image in thefirst and second regions eight times continuously in the period fromtime t1 to time t16.

The period from time t1 to time t3, the period from time t4 to time t7,the period from time t8 to time t11, and the period from time t12 totime t15 are charge accumulation times (exposure times) in the firstregion. These charge accumulation times (exposure times) are set in theimage capture condition setting process in step S23. The period fromtime t2 to time t5, the period from time t6 to time t9, the period fromtime t10 to time t13, and the period from time t14 to time t16 arecharge accumulation times (exposure times) in the second region. Thesecharge accumulation times (exposure times) are also set in the imagecapture condition setting process in step S23.

The pixel signals read from the pixels in the first region of the imagesensor 100 are amplified by the amplifier 412 using the gain indicatedby the division unit 71 and then outputted to the image processing unit30. The image generation unit 31A identifies the parameters used inimage processing, such as color signal processing, on the basis of theinstruction signal outputted from the division unit 71 and indicatingthe image capture conditions of the first region. The image generationunit 31A then generates first-region image data by performing varioustypes of image processing on RAW data composed of the pixel signals fromthe pixels in the first region on the basis of the parameters.

The pixel signals read from the pixels in the second region of the imagesensor 100 are amplified by the amplifier 412 using the gain indicatedby the division unit 71 and then outputted to the image processing unit30. The image generation unit 31B identifies the parameters used inimage processing, such as color signal processing, on the basis of theinstruction signal outputted from the division unit 71 and indicatingthe image capture conditions of the second region. The image generationunit 31B then generates second-region image data by performing varioustypes of image processing on RAW data composed of the pixel signals fromthe pixels in the second region on the basis of the parameters. Further,the image generation unit 31 (image generation unit 31A or 31B) combinesthe first-region image data and second-region image data.

In the second still image mode shown in FIG. 12(B), the drive controlunit 72 causes the drive unit 21 to control the drive of the imagesensor 100 so that the image sensor 100 starts to capture images in thefirst and second regions at different timings. Accordingly, assumingthat the image sensor 100 can capture, for example, 30 still images perminute in the first still image mode shown in FIG. 12(A), it can captureapproximately 60 still images per minute, which is approximately doublethat in the first still image mode, in the second still image mode shownin FIG. 12(B). In this case, the pixel region 113A is divided into thefirst and second regions and therefore the number of pixels in a stillimage is halved. However, assuming that the pixel region has 20 millionpixels, a still image having 10 million pixels, which is half the 20million pixels, is captured. Such a still image is thought to providesufficient image quality for the user.

If the division unit 71 sets first to third regions in the pixel region113A in accordance with the fourth block arrangement pattern shown inFIG. 8(D) in the second still image mode, continuous image capture canbe performed at higher speed than when setting the first and secondregions in the pixel region 113A. For example, assuming that 30 stillimages can be captured per minute in the first still image mode, ifthree regions are set in the pixel region 113A in the second still imagemode, approximately 90 images per minute, which is approximately threetimes that in the first still image mode, can be captured. Image sensors100 are expected to have more pixels from now on. For this reason, evenif the pixel region 113A is divided into three regions and thus thenumber of pixels in one still image is reduced to ⅓, the user would payhigher attention to the high speed of continuous image capture than tothe reduction in image quality.

Referring back to FIG. 9, the display control unit 73 outputs the imagedata generated by the image processing unit 30 to the display unit 50 soas to display still images on the first display unit 51 or seconddisplay unit 53 (step S8). If the drive control unit 72 causes the driveunit 21 to capture still images in the first still image mode, thedisplay control unit 73 displays the still images on the first displayunit 51. In contrast, if the drive control unit 72 causes to the driveunit 21 to capture still images in the second still image mode, thedisplay control unit 73 displays, on the first display unit 51, multiplestill images as thumbnail images obtained by capturing a still imagemultiple times continuously. Further, the display control unit 73displays a thumbnail image selected by the user on the second displayunit 53 in an enlarged manner.

FIG. 13 is a drawing showing an example display in which still imagesare displayed on the first display unit and second display unit. Asshown in FIG. 13, the display control unit 73 is displaying eightthumbnail images (still images) 511 to 518 side by side on the firstdisplay unit 51. For example, the thumbnail image 511 is a still imageresulting from the first image capture in FIG. 12(B). Similarly, thethumbnail images 512 to 518 are still images resulting from the secondto eighth image capture in FIG. 12(B).

As shown in FIG. 13, eight touch regions 511 a to 518 a are formed onthe first touchscreen 52 in such a manner that the eight touch regions511 a to 518 a are superimposed on the eight thumbnail images 511 to518, respectively. When any of the touch regions 511 a to 518 a detectsthat it has been pressed (touched) by the user, the touch region outputsa detection signal indicating the pressed position (the pressed touchregion) to the system control unit 70.

The display control unit 73 displays a thumbnail image corresponding tothe touch region pressed by the user on the second display unit 53 in anenlarged manner. In the example shown in FIG. 13, in response to theuser pressing the touch region 513 a, the thumbnail image 513corresponding to the touch region 513 a is being displayed on the seconddisplay unit 53 in an enlarged manner.

Referring back to FIG. 9, if the division unit 71 determines in step S2that the image capture mode is not the still image mode, that is, theimage capture mode is the moving image mode, it determines whether themoving image mode is the first moving image mode (step S10). If thedivision unit 71 determines that the moving image mode is the firstmoving image mode, it sets the image capture mode to the first movingimage mode (step S11). In contrast, if the division unit 71 determinesthat the moving image mode is not the first moving image mode, that is,the moving image mode is the second moving image mode, it sets the imagecapture mode to the second moving image mode (step S12).

In step S11 or step S12, the division unit 71 performs the blockarrangement pattern setting process shown in FIG. 10. In the processshown in FIG. 10, the division unit 71 instructs the image processingunit 30 (first image processing unit 30A) to detect main subjects (stepS21). The detection unit 32A then detects a moving subject and anon-moving subject by making a comparison among multiple pieces of imagedata chronologically obtained from live view images. In the presentembodiment, the detection unit 32A recognizes a face in the pieces ofimage data on the basis of eyes, mouse, the color of a skin, or the likeand detects the face as a moving subject. Further, in the presentembodiment, the detection unit 32A detects the face, as well as detectsa human body (person) included in the pieces of image data as a movingsubject. The detection unit 32A then outputs the detection result alongwith the pieces of image data to the system control unit 70. Thedivision unit 71 checks whether there are main subjects, on the basis ofthe detection result from the detection unit 32A. The division unit 71then sets a region (s) corresponding to the main subjects and the imagecapture mode in the pixel region 113A (step S22).

Specifically, if the image capture mode is the first moving image mode,the division unit 71 does not divide the pixel region 113A into multipleregions. That is, the division unit 71 sets the entire pixel region 113Aas a single region. At this time, the division unit 71 outputs, to thedrive unit 21, an instruction signal instructing the drive unit 21 toset the entire pixel region 113A as a single region.

In contrast, if the image capture mode is the second moving image mode,the division unit 71 selects one of the arrangement patterns shown inFIGS. 8(A) to 8(D). The division unit 71 then checks whether the mainsubject is a moving subject, on the basis of the detection result fromthe detection unit 32A. If the main subject is not a moving subject buta non-moving subject, the division unit 71 sets first and second regionsin accordance with the third block arrangement pattern shown in FIG.8(C). If the main subject is a moving subject, the division unit 71identifies the moving direction of the moving subject. If the movingdirection of the moving subject is mostly vertical, the division unit 71sets first and second regions in accordance with the first blockarrangement pattern shown in FIG. 8(A). If the moving direction of themoving subject is mostly horizontal, the division unit 71 sets first andsecond regions in accordance with the second block arrangement patternshown in FIG. 8(B). Further, if the vertical moving speed of the movingsubject is high, the division unit 71 sets first to third regions inaccordance with the fourth block arrangement pattern shown in FIG. 8(D).In step S22, the division unit 71 outputs, to the drive unit 21, aninstruction signal indicating the block positions or the like in therespective regions (first and second regions, first to third regions).

FIG. 14 is a diagram showing an example of the second block arrangementpattern set in the second moving image mode. In FIG. 14, the blocks arescaled up in order to make it easy to see the block arrangement. Inpractice, smaller blocks than the blocks shown in FIG. 14 are set in thepixel region 113A. In the example shown in FIG. 14, the detection unit32A detects persons O1, O2 who are playing soccer and a soccer ball O3as main subjects (moving subjects). The detection unit 32A detects thepersons O1, O2 included in image data as moving subjects. The divisionunit 71 determines that the main subjects O1 to O3 are moving subjectsand the moving directions of the moving subjects are mostly horizontal,on the basis of the detection result from the detection unit 32A. As aresult, the division unit 71 sets first and second regions in accordancewith the second block arrangement pattern shown in FIG. 8(B). Thedivision unit 71 also determines that the moving subjects O1, O2 arepersons. As a result, the division unit 71 defines regions 200, 201surrounding the moving subjects O1, O2 in the second region as secondregions A and a region other than the regions 200, 201 surrounding themoving subjects O1, O2 as a second region B.

Referring back to FIG. 10, the drive control unit 72 sets image captureconditions for the regions (the first region, second regions A, andsecond region B in the example shown in FIG. 14) set in step S22 on thebasis of the detection result from the detection unit 32A (step S23).Specifically, the drive control unit 72 outputs, to the drive unit 21,an instruction signal indicating image capture conditions (frame rates,gains, etc.) corresponding to the main subjects. The drive control unit72 also outputs, to the image processing unit 30, an instruction signalindicating image capture conditions (parameters, such as color signalprocessing, white balance adjustment, gradation adjustment, andcompressibility) corresponding to the main subjects.

For example, if the detection unit 32A detects moving subjects, thedrive control unit 72 increases the gain (ISO sensitivity) of the firstregion, as well as reduces the charge accumulation time of the firstregion. If the detection unit 32A does not detect any moving subject,the drive control unit 72 reduces the gain of the first region, as wellas increases the charge accumulation time of the first region. Further,if the detection unit 32A detects moving subjects, the drive controlunit 72 increases the frame rates of the regions of the moving subjects(the regions 200, 201 surrounding the moving subjects O1, O2, that is,the second regions A). The frame rate of the region of the non-movingsubject (the region other than the regions surrounding the movingsubjects O1, O2, that is, the second region B) is made lower than thatof the second regions A.

Referring back to FIG. 9, the drive control unit 72 determines whetherthe user has operated the moving image switch 55 c (step S13). If thedrive control unit 72 determines that the user has operated the movingimage switch 55 c, it causes the image capture unit 20 to capture imagesin the moving image mode (first moving image mode or second moving imagemode) (step S14). Image capture in the first moving image mode issimilar to typical moving image capture and therefore will not bedescribed in detail.

FIG. 15 is a timing chart showing charge accumulation timings in thesecond moving image mode. For example, a first region, a second regionA, and a second region B are set in the second moving image mode (stillimage-moving image mixed mode) shown in FIG. 15. While the user operatesthe release switch 55 c in the second moving image mode, the drivecontrol unit 72 outputs, to the drive unit 21, an instruction signalinstructing the drive unit 21 to repeatedly capture a still image in thefirst region and to capture moving images in the second regions A and B.In FIG. 15, while the user operates the release switch 55 c, the driveunit 21 causes the image sensor 100 to capture a still image byaccumulating charge in the pixels of the first region for a chargeaccumulation time T1. Further, while the user operates the releaseswitch 55 c, the drive unit 21 causes the image sensor 100 to capturemoving images in the second region A by accumulating charge in thepixels of the second region A for a charge accumulation time T2A.Furthermore, while the user operates the release switch 55 c, the driveunit 21 causes the image sensor 100 to capture moving images the secondregion B by accumulating charge in the pixels of the second region B fora charge accumulation time T2B which is longer than the chargeaccumulation time T2A. The frame rate varies with the chargeaccumulation time. Accordingly, the frame rate of moving images variesbetween when images are captured for the charge accumulation time T2Aand when images are captured for the charge accumulation time T2B. Forexample, the frame rate corresponding to the charge accumulation timeT2A of the second region A is 60 fps, and the frame rate correspondingto the charge accumulation time T2B of the second region B is 30 fps.The charge accumulation time or frame rate is set in the image capturecondition setting process in step S23.

Pixel signals read from the pixels in the first region of the imagesensor 100 are amplified by the amplifier 412 using the gain indicatedby the division unit 71 and then outputted to the image processing unit30. The image generation unit 31A identifies the parameters used inimage processing, such as color signal processing, on the basis of theinstruction signal outputted from the division unit 71 and indicatingthe image capture conditions of the first region. The image generationunit 31A then generates first-region image data by performing varioustypes of image processing on RAW data composed of the pixel signals fromthe pixels in the first region on the basis of the parameters.

Pixel signals read from the pixels in the second region A of the imagesensor 100 are amplified by the amplifier 412 using the gain indicatedby the division unit 71 and then outputted to the image processing unit30. The image generation unit 31B identifies the parameters used inimage processing, such as color signal processing, on the basis of theinstruction signal outputted from the division unit 71 and indicatingthe image capture conditions of the second region A. The imagegeneration unit 31B then second-region-A image data by performingvarious types of image processing on RAW data composed of the pixelsignals from the pixels in the second region A on the basis of theparameters.

Pixel signals read from the pixels in the second region B of the imagesensor 100 are amplified by the amplifier 412 using the gain indicatedby the division unit 71 and then outputted to the image processing unit30. The image generation unit 31B identifies the parameters used inimage processing, such as color signal processing, on the basis of theinstruction signal outputted from the division unit 71 and indicatingthe image capture conditions of the second region B. The imagegeneration unit 31B then generates second-region-B image data byperforming various types of image processing on RAW data composed of thepixel signals from the pixels in the second region B on the basis of theparameters. Further, the image generation unit 31 (image generation unit31A or 31B) combines the second-region-A image data and thesecond-region-B image data. Furthermore, the image generation unit 31(image generation unit 31A or 31B) combines the first-region image data,second-region-A image data, and second-region-B image data.

Since the frame rate of the second region A is made higher than theframe rate of the second region B as described above, the persons O1, O2serving as moving subjects move smoothly in moving images.

Referring back to FIG. 9, the display control unit 73 outputs the movingimage data generated by the image processing unit 30 to the display unit50 so as to display moving images on the first display unit 51 (stepS8). The display control unit 73 also outputs the still image datagenerated by the image processing unit 30 to the display unit 50 so asto display still images on the second display unit 53 (step S8).

FIG. 16 is a drawing showing an example display in which moving imagesare displayed on the first display unit and a still image is displayedin the second display unit. As shown in FIG. 16, the display controlunit 73 is displaying, on the first display unit 51, moving images(moving images in which the two persons are playing soccer) resultingfrom the combination of the second regions A and B by the imagegeneration unit 31. The display control unit 73 is also displaying thestill image of the first region generated by the image generation unit31 on the second display unit.

As described above, the electronic apparatus 1 of the first embodimentincludes the drive control unit 72, which controls the drive of theimage sensor 100, the division unit 71, which divides the pixel region113A of the image sensor 100 into at least first and second regions, andthe image generation unit 31, which generates a first image by capturingan image of the same subject in the first region and generates a secondimage by capturing an image of the subject in the second region.According to this configuration, multiple types of images (multiplestill images, a still image and moving images, etc.) of the same subjectcan be generated. Thus, multiple types of images can be generated inaccordance with the subject or image capture situation. That is, theelectronic apparatus 1 including the image sensor 100 provides highusability.

Further, the drive control unit 72 controls the drive of the imagesensor 100 so that the image sensor 100 starts to capture images in thefirst and second regions at different timings. According to thisconfiguration, multiple types of images of the same subject can begenerated at various timings. Further, many images can be generated perunit time. Thus, the user can capture images without letting good imagecapture timings slip away.

Further, the drive control unit 72 captures images in the second regionwhile capturing images in the first region. Thus, it is possible tocapture images in the first and second regions in parallel and thus tocapture images of the same subject in such a manner that the exposuretimes of the images overlap each other. As a result, images of the samesubject can be captured at timings when images cannot be capturedconventionally. The drive control unit 72 also sets at least one ofdifferent frame rates, different gains, and different exposure times forthe first region and second region of the image sensor 100 as imagecapture conditions. According to this configuration, the user can obtainmultiple types of images captured on different image capture conditions.

Further, the image generation unit 31 generates a still image on thebasis of at least one of an image captured in the first region and animage captured in the second region. Thus, multiple types of stillimages of the same subject can be generated. Further, the imagegeneration unit 31 generates moving images on the basis of one of imagescaptured in the first region and images captured in the second region.Thus, a still image and moving images of the same subject can begenerated. Further, the image generation unit 31 corrects the first andsecond regions using at least one of different white balances, differentgradations, and different color corrections. Thus, the user can obtainmultiple types of images processed on the basis of different parameters.

Further, the division unit 71 forms a first region from multiplediscrete regions (multiple discrete blocks). Thus, a reduction in theresolution of parts of an image is prevented. Further, the division unit71 variably divides the pixel region into first and second regions.Thus, the pixel region can be divided into regions in accordance withvarious situations such as the image capture mode and the subject type.

Further, the detection unit 32A detects a main subject from imagesgenerated by the image generation unit 31, and the division unit 71divides the pixel region into first and second regions in such a mannerthat the main subject is contained in both the first and second regions.Thus, an image of the main subject in the first region and an image ofthe main subject in the second region can be generated. Further, thedisplay control unit 73 displays an image generated by the imagegeneration unit 31 on the display unit 50. Thus, the user can check theimage displayed on the display unit 50. Further, the image sensor 100has a structure in which a back-illuminated image capture chip and asignal processing chip are stacked. Thus, the volume required to containthe image sensor 100 can be reduced. Further, the drive of the imagesensor 100 is controlled on the basis of an instruction from the systemcontrol unit 70. Thus, the load of the system control unit 70 can bereduced, and the image sensor 100 can be easily mounted on theelectronic apparatus 1.

While the electronic apparatus 1 according to the first embodiment shownin FIG. 5 includes the display unit 50, the display unit 50 may bedisposed outside the electronic apparatus. In this case, the systemcontrol unit 70 and display unit 50 are each provided with acommunication unit that receives and transmits signals (image data,control signals, and the like) by wire or wirelessly. Further, the imageprocessing unit 30 and system control unit 70 may be formed integrallywith each other. In this case, the respective functions of the imageprocessing unit 30 and system control unit 70 are implemented when asystem control unit including one or more CPUs performs processing onthe basis of a control program. While the image processing unit 30includes the two image processing units, 30A and 30B, it may includeonly one image processing unit.

Next, a modification of the first embodiment will be described. Theblock arrangement patterns in FIGS. 8(A) to 8(C) are set such that thefirst and second regions have the same area. Specifically, the blockarrangement patterns are set such that the first and second regions havethe same number of pixels. The block arrangement pattern in FIG. 8(D) isset such that the first to third regions have the same area.Specifically, the block arrangement pattern is set such that the firstto third regions have the same number of pixels. However, a blockarrangement pattern may be set such that respective regions havedifferent areas (the different numbers of pixels).

FIG. 17 is a diagram showing a fifth block arrangement pattern. Thefifth block arrangement pattern shown in FIG. 17 is a block arrangementpattern in which the pixel region 113A is divided into two regions,first and second regions. In the fifth block arrangement pattern, thesecond region of the pixel region 113A is composed of blocks in (3m)thcolumns, and the first region thereof is composed of blocks other thanthe blocks in the second region, that is, the first region is composedof blocks in (3m−2)th columns and blocks in (3m−1)th columns. As usedherein, m is a positive integer (m=1, 2, 3, etc.). In this blockarrangement pattern, the ratio between the areas of the first and secondregions is 2:1.

FIG. 18 is a diagram showing a sixth block arrangement pattern. Thesixth block arrangement pattern shown in FIG. 18 is a block arrangementpattern in which the pixel region 113A is divided into two regions,first and second regions. In the sixth block arrangement pattern, thesecond region of the pixel region 113A is composed of blocks in (2m−1)thcolumns and in (4n−1)th rows and blocks in (2m)th columns and in(4n−3)th rows, and the first region thereof is composed of blocks otherthan the blocks in the second region. As used herein, m and n arepositive integers (m=1, 2, 3, etc.; n=1, 2, 3, etc.). In thisarrangement pattern, the ratio between the areas of the first and secondregions is 3:1.

In step S22 of FIG. 10, if the division unit 71 determines that theimage capture mode selected by the user is the second moving image mode,it sets first and second regions in accordance with the fifth blockarrangement pattern shown in FIG. 17 or the sixth block arrangementpattern shown in FIG. 18. If the division unit 71 determines that themain subject is a non-moving subject, on the basis of the detectionresult from the detection unit 32A, it sets first and second regions inaccordance with the sixth block arrangement pattern shown in FIG. 18. Ifthe division unit 71 determines that the main subject is a movingsubject and the moving direction of the moving subject is mostlyvertical, on the basis of the detection result from the detection unit32A, it sets first and second regions in accordance with the fifth blockarrangement pattern shown in FIG. 17.

Then, in step S14, the drive control unit 72 outputs an instructionsignal to the drive unit 21 so as to cause the drive unit 21 to capturea still image in the first region and moving images in the secondregion. If the first and second regions are set in accordance with thefifth block arrangement pattern, the number of pixels in a still imageis twice the number of pixels in a moving image. That is, the resolutionof a still image is twice as high as that of a moving image. If thefirst and second regions are set in accordance with the sixth blockarrangement pattern, the number of pixels of a still image is threetimes the number of pixels of a moving image. That is, the resolution ofa still image is three times as high as that of a moving image. This isbecause a still image is required to have finer image quality than amoving image. Further, in moving images, the subject is mostly movingand therefore a reduction in image quality is less remarkable than in astill image. For these reasons, more regions are assigned to a stillimage than to moving images. Assuming that the number of pixels in thepixel region 113A is 20 million pixels, even when the number of pixelsof moving images (the number of pixels in the second region) is reducedto ⅓ or ¼, 6.66 million or 5 million pixels is ensured. Such a pixelnumber is comparable to the pixel number of a commercially availablevideo camera.

Second Embodiment

In the first embodiment, as shown in FIG. 12(B), the image sensor 100starts to capture images in the first and second regions at differenttimings in the second still image mode. In a second embodiment, in asecond still image mode, an image sensor 100 starts to capture images infirst and second regions at the same timing, and the first region andsecond region have different exposure times (i.e., charge accumulationtimes).

FIG. 19 is a timing chart showing charge accumulation timings in thesecond embodiment. In FIG. 19, first and second regions are set in thesecond still image mode. As shown in FIG. 19, while the user operates arelease switch 55 a, a drive unit 21 causes the image sensor 100 torepeatedly capture a still image in the first region by accumulatingcharge in the pixels of the first region for a charge accumulation time(exposure time) T11. Further, while the user operates the release switch55 a, the drive unit 21 causes the image sensor 100 to repeatedlycapture a still image in the second region by accumulating charge in thepixels of the second region for a charge accumulation time (exposuretime) T12. In this case, the image sensor 100 starts to capture imagesin the first and second regions at the same timing. On the other hand,the charge accumulation time T11 of the first region and the chargeaccumulation time T12 of the second region are different. Specifically,the charge accumulation time T12 is set to a time longer than the chargeaccumulation time T11. These charge accumulation times are set in theimage capture condition setting process in step S23.

Pixel signals read from the pixels in the first region of the imagesensor 100 are amplified by an amplifier 412 using a gain indicated by adivision unit 71 and then outputted to an image processing unit 30. Animage generation unit 31A identifies parameters used in imageprocessing, such as color signal processing, on the basis of aninstruction signal outputted from the division unit 71 and indicatingthe image capture conditions of the first region. The image generationunit 31A then generates first-region image data by performing varioustypes of image processing on RAW data composed of the pixel signals fromthe pixels in the first region on the basis of the parameters.

Pixel signals read from the pixels in the second region of the imagesensor 100 are amplified by the amplifier 412 using a gain indicated bythe division unit 71 and then outputted to the image processing unit 30.The image generation unit 31B identifies parameters used in imageprocessing, such as color signal processing, on the basis of aninstruction signal outputted from the division unit 71 and indicatingthe image capture conditions of the second region. The image generationunit 31B then generates second-region image data by performing varioustypes of image processing on RAW data composed of the pixel signals fromthe pixels in the second region on the basis of the parameters. Further,an image generation unit 31 (image combination unit 31A or 31B) combinesthe first-region image data and the second-region image data.

FIG. 20 is a drawing showing an example display according to the secondembodiment in which still images are displayed on a first display unitand a second display unit. In FIG. 20, a display control unit 73 (notshown) is displaying a still image (an image of a person captured atnight) of the first region in a left region 53L of the display screen ofa second display unit 53. The display control unit 73 is also displayinga still image of the second region in a right region 53R of the displayscreen of the second display unit 53. The display control unit 73 isalso displaying, in a central region 51G of a first display unit 51, astill image obtained by combining the still image of the first regionand the still image of the second region.

High-dynamic-range (HDR) imaging is widely known as a typical imagecombining technology for recording and displaying an image with a widedynamic range. In HDR imaging, an image having less blown-out highlightsor blocked-up shadows is generated by capturing multiple images whilechanging image capture conditions (e.g., exposure) and then combiningthe images. However, in conventional HDR, for example, two images arecaptured on different image capture conditions for different imagecapture times and therefore the subject may move or the user (operator)may move an electronic apparatus 1. In this case, the two images are notimages of the same subject and therefore are difficult to combine. Inthe second embodiment, on the other hand, two images can be captured ondifferent image capture conditions at the same (or approximately thesame) time. This configuration of the second embodiment can solve theproblem with the conventional HDR imaging. Note that the user can selectthe HDR mode, for example, by operating a multi-selector 55 d.

Third Embodiment

A configuration of a third embodiment is obtained by dividing theelectronic apparatus 1 of the first embodiment into an image capturedevice 1A and an electronic apparatus 1B.

FIG. 21 is a block diagram showing the configuration of the imagecapture device and electronic apparatus according to the thirdembodiment. In the configuration shown in FIG. 21, the image capturedevice 1A captures images of subjects. The image capture device 1Aincludes a lens unit 10, an image capture unit 20, an image processingunit 30, a work memory 40, an operation unit 55, a recording unit 60,and a first system control unit 75. The 10, image capture unit 20, imageprocessing unit 30, work memory 40, operation unit 55, and recordingunit 60 of the image capture device 1A are similar to those shown inFIG. 5. Accordingly, the same elements are given the same referencesigns and will not be described repeatedly.

The electronic apparatus 1B displays images (still images, movingimages, live view images). The electronic apparatus 1B includes adisplay unit 50 and a second system control unit (control unit) 70B. Thedisplay unit 50 of the electronic apparatus 1B is similar to that shownin FIG. 5. Accordingly, the same elements are given the same referencesigns and will not be described repeatedly.

The first system control unit 75 includes a first communication unit75A. The second system control unit 76 includes a second communicationunit 76B. The first communication unit 75A and second communication unit76B transmit and receive signals to and from each other by wire orwirelessly. The first system control unit 75 includes, for example,elements equivalent to the division unit 71 and drive control unit 72 ofthe elements shown in FIG. 7. The second system control unit 76includes, for example, only an element equivalent to the display controlunit 73 of the elements shown in FIG. 7.

The elements shown in FIG. 7 (division unit 71, drive control unit 72,and display control unit 73) may be disposed in any of the first systemcontrol unit 75 and second system control unit 76. Specifically, all theelements shown in FIG. 7 may be disposed in one of the first systemcontrol unit 75 and second system control unit 76, or some of theelements shown in FIG. 7 may be disposed in the first system controlunit 75, and the other elements may be disposed in the second systemcontrol unit 76.

Examples of the image capture device 1A include digital cameras,smartphones, mobile phones, and personal computers which each have imagecapture and communication functions. Examples of the electronicapparatus 1B include smartphones, mobile phones, and portable personalcomputers which each have a communication function.

The first system control unit 75 shown in FIG. 21 is implemented when aCPU (not shown) performs processing on the basis of a control program.The second system control unit 76 shown in FIG. 21 is implemented when aCPU (not shown) performs processing on the basis of a control program.

In the configuration shown in FIG. 21, the image processing unit 30 andfirst system control unit 75 may be formed integrally with each other.In this case, the functions of the image processing unit 30 and firstsystem control unit 75 are implemented when a system control unitincluding one or more CPUs performs processing on the basis of a controlprogram.

While the present invention has been described using the embodiments,the technical scope of the invention is not limited to the scopedescribed in the embodiments. Various changes or modifications can bemade to the embodiments without departing from the spirit and scope ofthe invention. Further, one or more of the elements described in theembodiments may be omitted. Any forms resulting from such changes,modifications, or omission are included in the technical scope of theinvention. Any elements of the embodiments or modifications thereof maybe combined as appropriate and used.

For example, in the first and second embodiments, the electronicapparatus 1 need not include the lens unit 10, recording unit 60, or thelike, as long as it includes the image capture unit 20, the imageprocessing unit 30 including the image generation unit 31, and thesystem control unit 70 including the division unit 71 and drive controlunit 72. That is, these elements may be elements independent of theelectronic apparatus 1. Also, in the third embodiment, the lens unit 10,recording unit 60, or the like may be an element independent of theimage capture device 1A.

While the color filters 102 form a Bayer array in the embodiments, theymay form other types of arrays. Each unit group 131 only has to includeat least one pixel. Each block also only has to include at least onepixel. Accordingly, it is possible to capture images on image captureconditions which vary among the pixels.

In the embodiments, part or all of the drive unit 21 may be included inthe image capture chip 113 or signal processing chip 111. Part of theimage processing unit 30 may be included in the image capture chip 113or signal processing chip 111. Part of the system control unit 70 may beincluded in the image capture chip 113 or signal processing chip 111.

While, in the embodiments, the gain, charge accumulation time (exposuretime, shutter speed), and frame rate serving as image capture conditionsare all variable, at least one of these only has to be variable. Whileonly the case in which the image capture conditions are setautomatically has been described, the imaging conditions may be set inresponse to the user operating the operation unit 55 or the like.

While the block arrangement patterns of the embodiments are exemplifiedin FIGS. 8(A) to 8(D), 17, and 18, other block arrangement patterns maybe employed. Further, the user may select among the block arrangementpatterns by operating the operation unit 55 or the like. A still imageor moving images captured by the image capture unit 20 may be displayedon any of the first display unit 51 and the second display unit 53.While the case in which the sizes of the block regions are previouslyset has been described in the embodiments, the user may set the sizes ofthe block regions.

In the first embodiment, the division unit 71 recognizes subjects on thebasis of live view images and then sets regions. Alternatively, thedivision unit 71 may recognize subjects on the basis of an image withrespect to which the user has just pressed the release switch 55 a ormoving image switch 55 c halfway and then may set regions.

In the first embodiment, an image capture mode for panning may beprovided. Panning is an image capture method for representing the senseof speed of a moving subject due to non-fluctuation of the movingsubject and fluctuation of the background (non-moving subjects). In thepanning image capture mode, a panning image whose charge accumulationtime (exposure time) is long and in which the background is streaking iscaptured in the first region, and a typical panning image whose chargeaccumulation time is shorter than that of the first region is capturedin the second region. The image generation unit 31 (or user) combinesthe panning image in the first region and the panning image in thesecond region as appropriate.

DESCRIPTION OF REFERENCE SIGNS

1,1B . . . electronic apparatus, 1A . . . image capture device, 20 . . .image capture unit, 30 . . . image processing unit, 31,31A, 31B . . .image generation unit, 32A . . . detection unit, 50 . . . display unit,51 . . . first display unit, 52 . . . first touchscreen, 53 . . . seconddisplay unit, 54 . . . second touchscreen, 70 . . . system control unit,70A . . . first system control unit, 70B . . . second system controlunit (control unit), 71 . . . division unit, 72 . . . drive controlunit, 73 . . . display control unit, 100 . . . image sensor

1. An imaging sensor, comprising: a plurality of pixels each including aphotoelectric converter that converts light into charge and a transfertransistor for transferring the charge resulting from conversion by thephotoelectric converter; a first control line that is connected to afirst transfer transistor included in each of a plurality of firstpixels disposed side by side in a row direction and a column directionamong the plurality of pixels, and receives a first control signal forcontrolling the first transfer transistor; and a second control linethat is connected to a second transfer transistor included in each of aplurality of second pixels disposed side by side in the row directionand the column direction among the plurality of pixels, and receives asecond control signal for controlling the second transfer transistor. 2.The imaging sensor according to claim 1, wherein the plurality of pixelseach includes a floating diffusion to which the charge converted by thephotoelectric converter is transferred by the transfer transistor and areset transistor that resets a potential of the floating diffusion, theimaging sensor further comprising: a third control line that isconnected to a first reset transistor included in each of the pluralityof first pixels, and receives a third control signal for controlling thefirst transfer transistor; and a fourth control line that is connectedto a second reset transistor included in each of the plurality of secondpixels, and receives a fourth control signal for controlling the secondtransfer transistor.
 3. The imaging sensor according to claim 1, theimaging sensor further comprising: a first output line that is connectedto the plurality of first pixels and receives a first signal based oncharge photoelectrically converted in each of the plurality of firstpixels; and a second output line that is connected to the plurality ofsecond pixels and receives a second signal based on chargephotoelectrically converted in each of the plurality of second pixels.4. The imaging sensor according to claim 3, the imaging sensor furthercomprising: a first current source that is connected to the first outputline and supplies current to the first output line; and a second currentsource that is connected to the second output line and supplies currentto the second output line.
 5. The imaging sensor according to claim 4,wherein the plurality of first pixels and the plurality of second pixelsare disposed on a first semiconductor chip, and the first current sourceand the second current source are arranged on a second semiconductorchip.
 6. The imaging sensor according to claim 5, wherein the firstsemiconductor chip is stacked on the second semiconductor chip.
 7. Theimaging sensor according to claim 3, the imaging sensor furthercomprising: a first signal processing circuit that performs signalprocessing on the first signal received by the first output line; and asecond signal processing circuit that performs signal processing on thesecond signal received by the second output line.
 8. The imaging sensoraccording to claim 7, wherein the first signal processing circuitincludes a first converter that converts the first signal into digitalsignal, and the second signal processing circuit includes a secondconverter that converts the second signal into digital signal.
 9. Theimaging sensor according to claim 8, wherein the plurality of firstpixels and the plurality of second pixels are disposed on a firstsemiconductor chip, and the first converter and the second converter aredisposed on a second semiconductor chip.
 10. The imaging sensoraccording to claim 9, wherein the first semiconductor chip is stacked onthe second semiconductor chip.
 11. The imaging sensor according to claim8, the imaging sensor further comprising: a first storage that storesthe first signal converted into the digital signal by the firstconvertor; and a second storage that stores the second signal convertedinto the digital signal by the second convertor.
 12. The imaging sensoraccording to claim 11, wherein: the plurality of first pixels and theplurality of second pixels are disposed on a first semiconductor chip;the first converter and the second converter are disposed on a secondsemiconductor chip; and the first converter and the second converter aredisposed on a third semiconductor chip.
 13. The imaging sensor accordingto claim 12, wherein the first semiconductor chip is disposed on thesecond semiconductor chip, and the second semiconductor chip is disposedon the third semiconductor chip.
 14. The imaging sensor according toclaim 2, the imaging sensor further comprising: a first output line thatis connected to the plurality of first pixels and receives a firstsignal based on charge photoelectrically converted in each of theplurality of first pixels; and a second output line that is connected tothe plurality of second pixels and receives a second signal based oncharge photoelectrically converted in each of the plurality of secondpixels.
 15. The imaging sensor according to claim 14, the imaging sensorfurther comprising: a first current source that is connected to thefirst output line and supplies current to the first output line; and asecond current source that is connected to the second output line andsupplies current to the second output line.
 16. The imaging sensoraccording to claim 15, wherein the plurality of first pixels and theplurality of second pixels are disposed on a first semiconductor chip,and the first current source and the second current source are disposedon a second semiconductor chip.
 17. The imaging sensor according toclaim 16, wherein the first semiconductor chip is stacked on the secondsemiconductor chip.
 18. The imaging sensor according to claim 14, theimaging sensor further comprising: a first signal processing circuitthat performs signal processing on the first signal received by thefirst output line; and a second signal processing circuit that performssignal processing on the second signal received by the second outputline.
 19. The imaging sensor according to claim 18, wherein the firstsignal processing circuit includes a first converter that converts thefirst signal into digital signal, and the second signal processingcircuit includes a second converter that converts the second signal intodigital signal.
 20. The imaging sensor according to claim 19, whereinthe plurality of first pixels and the plurality of second pixels aredisposed on a first semiconductor chip, and the first converter and thesecond converter are disposed on a second semiconductor chip.
 21. Theimaging sensor according to claim 20, wherein the first semiconductorchip is stacked on the second semiconductor chip.
 22. The imaging sensoraccording to claim 19, the imaging sensor further comprising: a firststorage that stores the first signal converted into the digital signalby the first convertor; and a second storage that stores the secondsignal converted into the digital signal by the second convertor. 23.The imaging sensor according to claim 22, wherein: the plurality offirst pixels and the plurality of second pixels are disposed on a firstsemiconductor chip; the first converter and the second converter aredisposed on a second semiconductor chip; and the first converter and thesecond converter are disposed on a third semiconductor chip.
 24. Theimaging sensor according to claim 23, wherein the first semiconductorchip is disposed on the second semiconductor chip, and the secondsemiconductor chip is disposed on the third semiconductor chip.
 25. Animaging apparatus comprising the imaging sensor according to claim 1.26. An imaging apparatus comprising the imaging sensor according toclaim
 2. 27. An imaging apparatus comprising the imaging sensoraccording to claim
 10. 28. An imaging apparatus comprising the imagingsensor according to claim
 13. 29. An imaging apparatus comprising theimaging sensor according to claim
 21. 30. An imaging apparatuscomprising the imaging sensor according to claim 24.